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Shannon entropy and Fisher information functionals are known to quantify certain 
information-theoretic properties of continuous probability distributions of various 
origins. We carry out a systematic study of these functionals, while assuming that 
the pertinent probability density has a quantum mechanical appearance p = \tp\ 2 , 
with ifi £ L 2 (R). Their behavior in time, due to the quantum Schrodinger picture 
evolution-induced dynamics of p(x, t) is investigated as well, with an emphasis on 
thermodynamical features of quantum motion. 



I. INFORMATION-IS THERE ANYTHING WHERE NOBODY LOOKS ? 

Shannon and von Neumann entropies are typical information theory tools which can be 
used to quantify the information content and possibly information loss/gain incurred by a 
quantum system, initially prepared in a specified (macro) state. The von Neumann entropy 
is known to vanish on pure states, hence one presumes to have a complete information about 
such state. An incomplete information concept thus seems to be related only to mixed states. 

On the other hand, right in connection with pure states of a quantum mechanical system, 
the Shannon entropy is known to give an access to another information theory level. Namely, 
it enables quantifying an information content of continuous probability distributions, that 
can be inferred from any ip G L 2 (R n ) vector by means of the Born recipe p = \ip\ 2 - 

Since, in physics, the very concept of entropy is typically interpreted as a measure of the 
degree of randomness and the tendency (trend) of physical systems to become less organized 
(disordered), it is quite natural to think of entropy as about the measure of uncertainty or 
disorder. Notions of information and uncertainty are deeply intertwined. Spectacular exam- 
ples of this intertwine are provided by information theory measures employed in quantum 
theory in the description of so-called entropic uncertainty relations that are valid in L 2 (R n ) 
for Born postulate- induced continuous probability densities, 3 . 

The term information, in the present context, may be literally understood as the inverse 
of uncertainty. As far as the notion of an organization is concerned, the Shannon entropy 
(and a number of other entropic measures) is known to quantify the degree of the prob- 
ability distribution complexity, 1 ', and (de) localization,-, for stationary and non-stationary 
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Schrodinger wave packets. 

Let us tentatively accept the casual statement that a (thermodynamically) isolated system 
is represented in quantum mechanics by a state vector which conveys statistic predictions 
for measurement outcomes. Then, we are tempted to identify and quantify an information 
content of a state vector, even though we know that the von Neumann entropy (the standard 
quantum measure of information) identically vanishes on a pure quantum state. The related 
semantic word-game due to Roger Penrose is worth mentioning: "when a system has a state 
there ought to be some property in the system that corresponds to its |?/')-ness", 4 . 

A more formal issue appears if we pass to the quantum dynamics, when we should in 
principle address an information theoretic interpretation of quantum evolutions. Clearly, in 
terms of the von Neumann entropy, nothing illuminating can be said about the quantum 
motion of pure or mixed states of an isolated system, since the unitary evolution leaves the 
von Neumann entropy intact. Therefore, the von Neumann entropy behavior in time may 
become interesting only if we pass from isolated to (thermodynamically) open systems. 

Quite to the contrary, the Shannon entropy of a continuous probability distribution may 
show up a non-trivial pattern of temporal behavior which deserves a closer inspection. Even, 
if our attention is confined to an isolated quantum system in its pure state. 



II. INFORMATION FUNCTIONALS AND INDETERMINACY RELATIONS 

Given an L 2 (i?)-normalized function ip(x). We denote (J-i[))(p) its Fourier transform. 
The corresponding probability densities follow: p(x) = \ip(x)\ 2 and p{p) = |(JF^)(p)| 2 . 
We introduce the related position and momentum information (differential, e.g. Shannon) 
entropies: 

S(p) = S g = — (lnp) = — J p{x)\np{x)dx (1) 

and 

S(p) = S p = -(lnp) = - J p(p) \np(p)dp (2) 

where S denotes the Shannon entropy for a continuous probability distribution. For the 
sake of clarity, we use dimensionless quantities, see e.g. however- for a discussion of how to 
handle dimensional quantities in the Shannon entropy definition. 

We assume both entropies to take finite values. Then, there holds the familiar entropic 
uncertainty relation-: 

S q + S p > (1 + lnvr). (3) 

If following conventions we define the squared standard deviation value for an observable 
A in a pure state ip as (AA) 2 = [jp, [A — (A)] 2 ip) with (A) = (ip, Aif)), then for the position 
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X and momentum P operators we have the following version of the entropic uncertainty 
relation (here expressed through so-called entropy powers, see e.g.-, % = 1): 

AX • AP > JL exp[S(p) + S{p)\ > \ (4) 

which is an alternative version of the entropic uncertainty relation. 

An important property of the Shannon entropy S(p) is that for a continuous probability 
distribution p(x) with an arbitrary finite mean (X) and a fixed variance a 2 = ((X — (X)) 2 ) = 
AX 2 we would have 

S(p) < \ ln^W) . (5) 

S(p) becomes maximized in the set of such densities if and only if p is a Gaussian with 
variance a 2 . For Gaussian densities, (2ne)AX ■ AP = exp[«S(p) + S(p)] holds true, but the 
minimum 1/2 on the right-hand-side of Eq. (j3J), is not necessarily reached. 

In below, we shall devote some attention to the Fisher information measure^: 

.F(p) = ((Vlnp) 2 >= f^-dx (6) 

which stays in a remarkable relationship with the Shannon entropy of the very same contin- 
uous probability distribution^: 

^(p)>(27re)exp[-25(p)]>^. (7) 

Clearly, we have T(p) > (1/a 2 ) with the equality allowed only if p is a Gaussian with 
variance a 2 . 

Let us notice that in view of properties of the Fourier transform, there is a complete 
symmetry between the inferred information-theory functionals. After the Fourier transfor- 
mation, the Parceval identity implies that the chain of inequalities Eq. ((Tj) can be faithfully 
reproduced (while replacing p by p) for the " momentum -space" density p with the variance 
a 2 . As a consequence, taking into account the entropic uncertainty relation Eq. ([3]), we 
arrive at^: 

4a 2 > 2(e7r)" 1 exp[-2(lnp)] > (2e7r) exp[2(lnp)] > a" 2 (8) 

Let us consider a momentum operator P that is conjugate to the position operator X 
in the adopted dimensional convention h = 1. Setting P = —id/dx and presuming that all 
averages are finite, we get: 

\{P 2 ) — (P) 2 ] = (AP) 2 = a 2 . (9) 

The standard indeterminacy relationship o ■ a > (1/2) follows. 

In the above, no explicit time-dependence has been indicated, but all derivations go 
through with any wave-packet solution ip(x,t) of the Schrodinger equation. The induced 
dynamics of probability densities may imply the time-evolution of entropies: S q (t), S p (t) and 
thence the dynamics of quantum uncertainty measures AX(t) = a(t) and AP(t) = (?(t). 
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III. HYDRODYNAMICAL VELOCITY FIELDS AND THEIR VARIANCES 

Let us consider the Schrodinger equation: 

iM = -DAil> + -¥-'il>. (10) 
2mV 

where the potential V = V(x ,t) (possibly time-dependent) is a continuous (it is useful, if 
bounded from below) function with dimensions of energy, D = h/2m. 
By employing the Madelung decomposition: 

tp = p 1/2 exp(is/2D) (11) 

with the phase function s = s(x,t) defining v = Vs we readily arrive at the continuity 
equation 

d t p = -VM (12) 
and the generalized Hamilton- Jacobi equation: 

dts + ^(Vs) 2 + (n-Q) = (13) 

where, after introducing an additional velocity field 

u(x,t) = DV\np(x,t) , (14) 

we have 

An 1 / 2 1 

Q = 2D 2 -^— = ~u 2 + DV-u. (15) 

If a quantum mechanical expectation value of the standard Schrodinger Hamiltonian 
H = -{h 2 /2m)A + V exists (i.e. is finite^), 

{i)\H\i)) = E < oo (16) 

then the unitary quantum dynamics warrants that this value is a constant of the Schrodinger 
picture evolution: 

H = \[{v 2 ) + (u 2 )] + (Q) = - (d t s) =£ = - = const. (17) 
Let us notice that (u 2 ) = —D(Vu) and therefore: 

Let us observe that D 2 T stands for the mean square deviation value of a function u(x, t) 
about its mean value (u) = 0, whose vanishing is a consequence of the boundary conditions 
(here, at infinity): 

(Au) 2 = a 2 u =([u-(u)] 2 ) = (u 2 )=D 2 ^. (19) 
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The mean square deviation of v(x,t) about its mean value (v) reads: 

(Av) 2 = ol = (v 2 ) - (v) 2 . (20) 

It is clear, that with the definition P = —i(2mD)d/dx, the mean value of the operator P is 
related to the mean value of a function v(x,t) (we do not discriminate between technically 
different implementations of the mean): (P) = m(v). Accordingly, 

a 2 = (AP) 2 = (P 2 ) - (P) 2 (21) 

Moreover, we can directly check that with p = \ip\ 2 there holds^: 



HP) = ^l = I d*M + r'(x)/r(x)} 2 = (22) 



' ■l(P 2 )-m 2 (v 2 )} = ^-[(AP) 2 -m 2 o 2 v } 



m 2 D 2 m 2 D 2 



i.e. 



m 2 (a 2 u + a 2 )=a 2 . (23) 

It is interesting to notice that ((P — mv)) = and the corresponding mean square deviation 
reads: 

((P - mv) 2 ) = (P 2 ) - m 2 (v 2 ) = m 2 D 2 T . (24) 

An interesting outcome of this discussion is a definite sharpening of an upper bound in 
the inequalities Eqs. ([7]). Namely, by passing to dimensionless quantities in Eqs. (12"2"I) (e.g. 
2mD = 1), and denoting p c[ = (arg ip(x,t))' we get: 

T = 4[(P 2 ) - (p 2 cl )] = 4[(AP) 2 - (A Pd ) 2 ] = 4[a 2 - a 2 d ) (25) 

and therefore the chain of inequalities Eq. ([7]) gets a sharper form with a manifest upper 
bound for the Shannon entropy of p = \ip\ 2 set by: 

4a 2 > 4[a 2 - a 2 ] = T > (2ne) exp[-2«S(p)] > ^ . (26) 

We recall that all "tilde" quantities can be deduced from the once given if) and its Fourier 
transform -0. 



IV. THERMODYNAMIC AL FEATURES OF THE QUANTUM DYNAMICS 

We have emphasized that a pure state of the quantum theory and its Schrodinger picture 
dynamics are normally attributed to a thermodynamically isolated quantum system. We 
would like to demonstrate that a number of essentially thermo dynamical features is encoded 
in this innocent-looking, apparently non-thermodynamical regime. To this end some basic 
notions of the non-equilibrium thermodynamics must be introduced. 
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A. Quantum detour - thermodynamics of open systems 

We shall give a concise resume of the pertinent framework following 10 . It is taken for 
granted that in case of an open quantum system, the bath drives a system to an equilibrium 
state. The state of the system plus reservoir is described by a density matrix. Let p t be the 
reduced density matrix of a quantum system in a combined weak coupling and adiabatic 
approximation of the general system-reservoir dynamic problem, t > 0: 

^-p t = -i[H sys {t),p t ] + L diss (t)p t = L(t)p t (27) 

We introduce the following thermodynamical notions: (i) an internal energy of the sys- 
tem E(t) = Tr(p t H sys (t)), (ii) the work performed on the system by external forces 
W(t) = f Tr[p s (-^H sys (s))]ds. (iii) the heat supplied to the system by the reservoir 
Q(t) = f*Tr[(ip s )H sy s(s))ds. 

The laws of thermodynamics, tailored to the manifestly non-equilibrium dynamical regime 
can now be formulated. The first law of thermodynamics reads: 

S E ") = > + >' < 28 > 

Let us introduce the relative entropy (p\<r) = Tr(plnp — plncr) and the account for the 
stationary state input L(t)p eq = , with p eq = Z~ x exp[— j3H sys {t)}. Then, the second law 
of thermodynamics takes the form: 

where o~(p t ) > is called the entropy production, while Q/T refers to the entropy/heat 
exchange with the bath. Obviously, we have TdS > dQ. 



B. Back to classical non-equilibrium thermodynamics 

For the record, we indicate that the following hierarchy of thermodynamic systems is 
adopted in the present paper— isolated with no energy and matter exchange with the 
environment, closed with the energy but no matter exchange and open where energy-matter 
exchange is unrestricted. 

Our previous discussion was confined to an open quantum system. Accepting the standard 
text-book wisdom that all isolated systems evolve to the state of equilibrium in which the 
entropy reaches its maximal value, we shall pay attention to closed random systems and 
their somewhat different asymptotic properties. A concise resume of a non-equilibrium 
thermodynamics of closed systems comprises the I st law of thermodynamics 

U = Q + W (30) 
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and the II law of thermodynamics: 

S — Si n t + S ex t , (31) 

where S int > and S ext = Q/T, c.f.— Let us emphasize that Q and W are always well 
defined, but the adopted (time derivative) notation does not imply that one may infer Q 
and W as legitimate thermodynamic functions, c.f. an issue of "imperfect differentials" in 
classical thermodynamics. 

Thermodynamic extremum principles are usually invoked in connection with the large 
time behavior of irreversible processes. One looks for direct realizations of the entropy 
growth paradigm, undoubtedly valid for isolated systems,—. Among a number of stan- 
dard thermodynamic extremum principles, we recall a specific one named the Helmholtz 
extremum principle. If the temperature T and the available volume V are kept constant, 
then the minimum of the Helmholtz free energy 

F = U -TS (32) 

is preferred in the course of the system evolution in time, and there holds 12 

F = -TS mt < (33) 

In below, we shall analyze the validity of thermodynamic principles and the role played by 
the direct analog of the Helmholtz free energy, in case of quantum motion, and specifically 
in the seemingly non-thermodynamical context of the Schrodinger picture evolution. 



C. Thermodynamical features of the quantum motion - closed systems in action 

We come back to the Schrodinger picture evolution of pure states in L 2 (R). We impose 
the natural boundary data on quantum motion and they are implicit (vanishing of various 
expressions at integration boundaries) in all averaging procedures in below. One must be 
aware that we pass-by a number of mathematical subtleties and take for granted that various 
computational steps are allowed. 

The continuity equation is a direct consequence of the Schrodinger equation. It is less 
obvious that, after employing the hydrodynamical velocity fields u(x, t) and v(x, t), the 
Fokker Planck equation for p = \ijj\ 2 may be deduced. We have: 

d tP = DAp - V ■ (bp) (34) 

where b = v + u = V(s + D In p) where u = DV In p. 



8 



The Shannon entropy of a continuous probability distribution S = — (lnp) follows and 
yields 

DS = (v 2 )-(b-v) = D{S int + S ext ) (35) 

which is a straightforward analog of the II nd law of thermodynamics in the considered 
quantum mechanical context: 

S int = S- S ext = (1/D) (v 2 ) >0^S>S ext . (36) 

To address an analog of the I st law we need to translate to the present setting the previously 
discussed thermodynamic notions of U and F = U — TS, where the notion of temperature is 
the most serious obstacle. We have no obvious notion of temperature for quantum systems 
in their pure states (for large molecules, like fullerenes or the likes, the notion of internal 
temperature makes sense, but we aim to consider any quantum system in a pure state, small 
or large). Therefore, we shall invoke a dimensional artifice^. 
We formally introduce 

UbTq = hojQ = mc 2 (37) 

and thence 

D = h/2m = k B T /m(3 (38) 
with (3q = 2uj = 2mc 2 /h, and so arrive at 



In view of: 



k B T S ext = Q . (39) 



Ws = b-u = V(s + D\np) - DV\np= (40) 
' V(V + k B T \np) = V V *> 



m(3 mfio 
where the time-dependent potential 

V = V(x,t) = -m(3 (s + Din p) (41) 

is defined to stay in a notational conformity with the standard Smoluchowski process (Brow- 
nian motion in a conservative force field^) definition b = —W/mf3o, we finally get 

— m(3(s) = (\&) = (V) — TS => F = U — TS , (42) 

where U = (V) and F = 

Remembering about an explicit time dependence of b(x,t) = — (l/m/? )VV A (x, t), we 
finally arrive at the I st law of thermodynamics in the present quantum context: 

(J = (d t V) - m(3 (bv) = W+Q. (43) 
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The externally performed work entry reads W = (d t V). But: 

V = -m(3s - k B T\np =^ (d t V) = -m(3 (d t s} = W 

and therefore 

- j f (s) = -(v 2 ) - (d t s) ^F = -T S int + W (44) 

where S int > 0. 

If a quantum mechanical expectation value of the standard Schrodinger Hamiltonian 
H = —(h 2 /2m)A + V exists (i.e. is finite), (ip\H\ip) = E < oo, then the unitary quantum 
dynamics warrants that this value is a constant of the Schrodinger picture evolution which 
(c.f. Eq. (jT3]) ) implies: 

H = ^[(v 2 ) + (u 2 )] + (0) = - (d t s) =£ = ^ = const. (45) 

Consequently, in the thermodynamical description of the quantum motion, we encounter a 
never vanishing constant work term 

W = m(3 8 = (3 {H) . (46) 

The associated Helmholtz-type extremum principle reads: 

F - m(3 £ = -T S int < . (47) 

It is instructive to notice that 

TS int = TS-Q>0^Q<TS (48) 

goes in parallel with 

F < W = Pq{H) . (49) 

Let us stress that the non-vanishing external work term is generic to the quantum motion. 
If a stationary state is considered, our (H) is equal to a corresponding energy eigenvalue. 

For negative eigenvalues, the work term receives an interpretation of the "work performed 
by the system" (upon its, hitherto hypothetical, surrounding ?). Then F is negative and F 
may possibly have a chance to attain a minimum. 

Since bounded from below Hamiltonians can be replaced by positive operators, we may 
in principle view mfloS = /3q (H) as a positive (constant and non- vanishing) time rate of the 
"work externally performed upon the system". This observation encompasses the case of 
positive energy spectra. Accordingly, F may take both negative and positive values. The 
latter up to an upper bound m(3o£. 
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Basic features of the non-equilibrium thermodynamics of closed irreversible systems, 
somewhat surprisingly have been reproduced in the quantum Schrodinger picture evolu- 
tion. We have identified direct analogues of the I st and the II laws of thermodynamics, 
together with the involved notions of S int > and S ext = (1/T)Q. 

An asymptotic behavior of the quantum motion is controlled by the analog of the II nd 
law: 

F — W = -mf3 Q j t ((s) + St) = -T S int < . (50) 

where there appears an work (performed upon or performed by the system) term W = 
(dtV) = m/3o£ value whose sign is indefinite (either positive or negative). 

Let us notice that in classical non-equilibrium thermodynamics the so-called minimum 
entropy production principle 11 is often invoked in connection with the "speed" with which 
a minimum of the Helmholtz free energy is approached. For sufficiently large times, when 
the system is in the vicinity of the stationary (equilibrium) state, one expects that the the 
entropy production TSi nt > is a monotonically decaying function of time, i.e. that 

J t S int < . (51) 

The quantum motion looks different. In that case, F may be positive and one cannot 
exclude transitions (including those of an oscillatory nature) from negative to positive F 
values and back. It may happen that in certain quantum states, the Helmholtz free energy 
F may have a minimum, a maximum, an infinite number of local minima and maxima, or 
none at all. There is no reason for the minimum entropy production principle to be valid in 
quantum theory, except for very special cases. 

There is however a "speed" property which is special for the quantum case, with no 
dissipative counterpart. Namely, since the work term is a constant of quantum motion and 
F + T Si n t = m/3 £, we have the following negative feedback relationship between the speeds 
of the growth/decay of the entropy production and the Helmholtz free energy time rate: 

lp = -T ^S int . (52) 
dt dt v ' 

If the Helmholtz free energy time rate drops down, the entropy production time rate needs 
to increase and in reverse. Therefore a minimum of F in principle may be achieved, if a 
maximum of the entropy production Si nt is attained. In reverse, a maximum of F may arise 
in conjunction with a minimum of Si nt . 

Remembering that T Q S int = m/? (t> 2 ) and exploiting the total mean energy formula, Eq. 
131) . we can identify the respective "speeds": 

j t F = (3 Q j t {m{u 2 )+2{V)) (53) 
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and 

Topint = ™Po^(v 2 ) (54) 

that stay in a feedback relationship. By recalling our discussion of Section III, we realize 
that variances of the hydrodynamical velocity fields decide about the time rate of the 
entropy production and Helmholtz free energy in the quantum case. They stay in the above 
mentioned feedback relationship, consult e.g. alsc^i. 
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